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SECTION  I. 


INTRODUCTION . 

-  The  purpose  of  this  Technical  Report  is  to  review  the 
Final  Software  Test  Description,  CDRL  A009-03,  which 
was  produced  for  the  Government  by  Evaluation  Research 
Corporation.  The  results  are  provided  in  the  form  of  Data 
Item  Discrepancy  worksheets  as  requested  by  the  CMOS  Program 
Office. 

SUMMARY.  Not  Used. 


CONCLUSION. 
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SECTION  II. 

RESULTS . 

.  Our  analysis  is  provided  in  the  attached  Data  Item 

*  Discrepancy  worksheets. 
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APPLICATIONS  CSCI 

The  following  comments  ^re  related  to  the 
Applications  CSCIs 
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ORIGINATOR  CONTROL  NUMBER:  STD1-0001 
PROGRAM  OFFICE  CONTROL  NUMBER: 

DATA  ITEM  DISCREPANCY  WORKSHEET 

CDRL  NUMBER:  A009-03  DATE:  10/28/90 

ORIGINATOR  NAME:  Ronald  J.  Lacour  OFFICE  SYMBOL:  SAIC 

TELEPHONE  NUMBER:  272-2999 
SUBSTANTIVE:  X  EDITORIAL: 

PAGE  NUMBER:  301  PARA  NUMBER:  4.40 

COMMENT  OR  RECOMMENDED  CHANGE: 

Correct  the  discrepancy  between  the  text  and  the  Table  of  Contents 
regarding  paragraph  numbering. 

RATIONALE: 

It  appears  paragraph  4.39  was  omitted  from  the  text  and  not  from  the  Table 
of  Contents ,  resulting  in  errors  in  paragraph  numbers  and  titles . 

CMOS  PMO  ACCEPTS  COMMENT:  YES  [  ]  NO  [  ] 

ERCI  ACCEPTS  COMMENT:  YES  [  ]  NO  [  ] 

COMMENT  DISPOSITION: 


COMMENT  STATUS:  OPEN  [  ]  CLOSED  [  ] 


ORIGINATOR  CONTROL  NUMBER:  STD1-0002 
PROGRAM  OFFICE  CONTROL  NUMBER: 


DATA  ITEM  DISCREPANCY  WORKSHEET 


CDRL  NUMBER:  A009-03 

ORIGINATOR  NAME:  Ronald  J.  Lacour 


TELEPHONE  NUMBER:  272-2999 


SUBSTANTIVE:  X  EDITORIAL: 


DATE:  10/28/90 


OFFICE  SYMBOL:  SAIC 


PAGE  NUMBER:  367 


PARA  NUMBER:  4.45.13.6 


COMMENT  OR  RECOMMENDED  CHANGE: 

Clarify  the  relationship  of  TD21.04  (Communication  STD)  with  TD1242.13. 
RATIONALE : 

Although  additional  narrative  was  added,  it  is  unclear  how  TD21.04  relates 
to  test  cases  of  TD1242.13.  This  is  a  resubmission  of  STD2A-0011. 

CMOS  PMO  ACCEPTS  COMMENT:  YES  [  ]  NO  [  ] 

ERCI  ACCEPTS  COMMENT:  YES  [  ]  NO  [  J 

COMMENT  DISPOSITION: 


:OMMENT  STATUS:  OPEN  [  ]  CLOSED  [  ] 


ORIGINATOR  CONTROL  NUMBER:  STD1-0003 
PROGRAM  OFFICE  CONTROL  NUMBER: 


DATA  ITEM  DISCREPANCY  WORKSHEET 


CDRL  NUMBER:  A009-03 


DATE:  10/28/90 


ORIGINATOR  NAME:  Ronald  J.  Lacour 


OFFICE  SYMBOL:  SAIC 


TELEPHONE  NUMBER:  272-2999 


SUBSTANTIVE:  X  EDITORIAL: 


PAGE  NUMBER:  380 


PARA  NUMBER:  4.46.1.6 


COMMENT  OR  RECOMMENDED  CHANGE: 

Change  4.45.11  to  4.45.9.68  in  this  paragraph. 

RATIONALE: 

The  ERC  letter,  "Response  to  Air  Force  Comments",  number  STD2A-0012, 
referred  to  paragraph  4.45.9.6.8  as  being  the  location  to  test  the  update 
of  the  truck  manifest. 

CMOS  PMO  ACCEPTS  COMMENT:  YES  [  ]  NO  [  ] 

ERC I  ACCEPTS  COMMENT:  YES  [  ]  NO  [  ] 

COMMENT  DISPOSITION: 


COMMENT  STATUS:  OPEN  [  ]  CLOSED  [  ] 


ORIGINATOR  CONTROL  NUMBER:  STD1-0004 
PROGRAM  OFFICE  CONTROL  NUMBER: 


DATA  ITEM  DISCREPANCY  WORKSHEET 

CDRL  NUMBER:  A009-03  DATE:  10/28/90 

ORIGINATOR  NAME:  Ronald  J.  Lacour  OFFICE  SYMBOL:  SAIC 

TELEPHONE  NUMBER:  272-2999 
SUBSTANTIVE:  X  EDITORIAL: 

PAGE  NUMBER:  411  PARA  NUMBER:  4.48.6.1 

COMMENT  OR  RECOMMENDED  CHANGE: 

Add  the  specific  MAC  manifest  transactions  to  this  test. 

RATIONALE: 

The  ERC  letter  which  accompanied  the  STD  states  in  part,  "...  the 
transactions  are  the  same  as  the  normal  transmission  of  TCMD  data  except 
for  the  header  and  trailer  records."  Some  MAC  transactions  (i.e.,  900, 
400,  and  505)  are  basically  TCMD  data.  However,  other  MAC  transactions 
are  not,  such  as  the  410  and  405  transactions  (see  IDD  page  D-90  and 
D-9 1 ) .  These  are  basically  manifest  transactions,  not  TCMD  data.  In 
addition,  routing  of  these  transactions  varies,  some  to  DPS-6,  some  to  MAC 
HOST,  and  some  to  both.  This  test  should  be  expanded  to  specify  which 
manifests  are  being  transmitted. 

CMOS  PMO  ACCEPTS  COMMENT:  YES  [  ]  NO  [  ] 

ERC I  ACCEPTS  COMMENT:  YES  [  ]  NO  [  ] 

COMMENT  DISPOSITION: 


COMMENT  STATUS:  OPEN  [  ]  CLOSED  [  ] 


COMMUNICATIONS  CSC I 

The  following  comments  are  related  to  the 
Communications  CSCI: 


ORIGINATOR  CONTROL  NUMBER:  STD2-0001 
PROGRAM  OFFICE  CONTROL  NUMBER: 


DATA  ITEM  DISCREPANCY  WORKSHEET 

CDRL  NUMBER:  A009-03  DATE:  10/28/90 

ORIGINATOR  NAME:  John  J.  Brassil  OFFICE  SYMBOL:  SAIC 

TELEPHONE  NUMBER:  272-2999 
SUBSTANTIVE:  X  EDITORIAL: 

PAGE  NUMBER:  21  PARA  NUMBER:  4. 1.3. 6 

COMMENT  OR  RECOMMENDED  CHANGE: 

Your  response  to  our  comment  STD2B-0002  indicates  that  the  reference  to 
TD1134.01  has  been  deleted,  and  it  has  not.  In  addition,  the  remainder  of 
our  recommended  change  was  ignored. 

RATIONALE: 

The  reference  to  both  TD1134.01  and  TD1134.04  is  still  found  in  the 
Rationale  section  of  paragraph  4. 1.3. 6.  Our  comment  also  indicated  that 
the  Rationale  paragraph  should  identify  exactly  what  requirements  are 
satisfied  by  which  test  cases  when  reference  is  made  to  more  than  one. 
There  are  numerous  cases  where  this  has  not  been  done,  such  as  paragraphs 
4. 1.7. 6,  4. 1.9. 6,  and  4. 2. 4. 6  (which  is  almost  identical  to  paragraph 
4. 1.3. 6).  All  test  procedure  paragraphs  that  have  this  problem  should  be 
corrected,  not  just  those  referenced  directly  in  our  comment. 

CMOS  PMO  ACCEPTS  COMMENT:  YES  [  ]  NO  [  ] 

ERCI  ACCEPTS  COMMENT:  YES  [  ]  NO  [  ] 

COMMENT  DISPOSITION: 


COMMENT  STATUS:  OPEN  [  ]  CLOSED  [  ] 


ORIGINATOR  CONTROL  NUMBER:  STD2-0002 
PROGRAM  OFFICE  CONTROL  NUMBER: 

DATA  ITEM  DISCREPANCY  WORKSHEET 
:DRL  NUMBER:  A009-03  DATE:  10/28/50 

DRIGINATOR  NAME:  John  J.  Brassil  OFFICE  SYMBOL:  SAIC 

TELEPHONE  NUMBER:  272-2999 
SUBSTANTIVE :  X  EDITORIAL: 

5 AGE  NUMBER:  115-118  PARA  NUMBER:  4.10.4.6 

ZOMMENT  OR  RECOMMENDED  CHANGE: 

four  response  to  our  comment  indicated  that  the  paragraph  had  been 
nodified  to  "eliminate"  the  confusion.  While  it  has  been  reduced,  it  has 
tot  yet  been  eliminated. 

RATIONALE: 

Our  comment  mentioned  the  use  of  the  label  "List  5"  for  more  than  one 
List.  This  problem  still  exists.  Suggest  you  use  the  same  procedure  as 
.vas  implemented  for  list  3,  e.g.,  the  addition  of  an  alphabetical  suffix. 
In  addition,  the  change  from  "user,  S/A"  to  "System  Administrator"  was  not 
nade  in  the  last  paragraph  of  the  first  column  on  page  117. 

ZMOS  PMO  ACCEPTS  COMMENT:  YES  [  ]  NO  [  ] 

ERCI  ACCEPTS  COMMENT:  YES  [  ]  NO  [  ] 

COMMENT  DISPOSITION: 


COMMENT  STATUS:  OPEN  [  ] 


CLOSED  [  ] 


> 


I 


I 
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SYSTEM  ENVIRONMENT  CSCI 

The  following  comments  are  related  to  the 
System  Environment  CSCI : 


I 


I 


I 


I 


ORIGINATOR  CONTROL  NUMBER:  STD3-0001 
PROGRAM  OFFICE  CONTROL  NUMBER: 


DATA  ITEM  DISCREPANCY  WORKSHEET 

CDRL  NUMBER:  A009-03  DATE:  10/28/90 

ORIGINATOR  NAME:  John  J.  Brassil  OFFICE  SYMBOL:  SAIC 

TELEPHONE  NUMBER:  272-2999 
SUBSTANTIVE:  X  EDITORIAL: 

PAGE  NUMBER:  24  PARA  NUMBER:  4. 3. 1.6 

COMMENT  OF  RECOMMENDED  CHANGE: 

The  Action  and  Rationale  paragraph  are  still  not  in  agreement, 
contradicting  your  response  to  comment  STD2C-0003  on  the  previous  version 
of  this  document. 

RATIONALE: 

The  Action  paragraph  states  that  testing  requirements  are  deleted  for 
paragraphs  3.3.1a-j,  4.3.1m,  =»nd  4. 3.  In.  The  Rationale  paragraph  lists 
4.3.1a-j,  1,  n,  and  p.  Paragraph  4. 3. 1.6. 3  tests  the  requirement  listed 
in  paragraph  4.1.3m,  so  it  does  not  belong  in  the  list  of  deleted 
requirements  found  in  the  Action  paragraph.  If  the  requirement  of 
paragraph  4.3.11  is  to  be  validated  at  FCA  as  indicated  in  the  Rationale 
paragraph,  it  should  be  added  to  the  Action  paragraph  as  one  of  the 
deleted  items.  Finally,  the  reference  to  paragraph  4.3.1p  should  be 
deleted  from  the  Rationale  paragraph,  since  it  is  not  mentioned  in  the 
Action  paragraph,  and  does  not  appear  in  paragraph  4.3.1. 

CMOS  PMO  ACCEPTS  COMMENT:  YES  [  ]  NO  [  ] 

ERC I  ACCEPTS  COMMENT:  YES  [  ]  NO  [  ] 

COMMENT  DISPOSITION: 


COMMENT  STATUS:  OPEN  [  ]  CLOSED  [  } 


